Papers with template selection
Mind Your Format: Towards Consistent Evaluation of In-Context Learning Improvements (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models demonstrate remarkable ability for learning to solve new tasks from a few examples. |
| Approach: | They propose to use templates to aggregate model predictions across multiple templates to improve model performance. |
| Outcome: | The proposed model ensembles boost model predictions while being robust to the choice of random set of templates. |
TYPIC: A Corpus of Template-Based Diagnostic Comments on Argumentation (2022.lrec-1)
Copied to clipboard
Shoichi Naito, Shintaro Sawada, Chihiro Nakagawa, Naoya Inoue, Kenshi Yamaguchi, Iori Shimizu, Farjana Sultana Mim, Keshav Singh, Kentaro Inui
| Challenge: | Argumentation and debate are effective tools for developing critical thinking skills, but it requires a lot of time and effort. |
| Approach: | They propose to automate the process of giving diagnostic comments to students . they define criteria for a template set that can be used to evaluate the model . |
| Outcome: | The proposed model can be used to evaluate arguments and evaluate them in real time. |